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(54) A hybrid just-in-time compiler that consumes minimal resources 



(57) A virtual machine with a hybrid just-in-time 
compiler that enables execution of a set of cross-plat- 
form code on a hardware platform. The hybrid just-in- 
time compiler consumes relatively few resources of the 
hardware platform by compiling only selected basic 



blocks of the cross-platform code and by malcing use of 
existing elements in the virtual machine that are other- 
wise used to interpret the cross-platform code. The just- 
in-time compiler is hybrid in that only selected basic 
blocks of the cross-platform code are compiled while the 
remaining portions are interpreted. 
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Description 

BACKGROUND OF THE INVENTION 

6 Field of invention 

[0001] The present invention pertains to the field of processing systems. More particularly, this invention relates to 
a hybrid just-in-time compiler that consumes minimal resources. 

10 Art Backaround 

[0002] Computer systems and devices having embedded processing resources typically conform to. one of a variety 
of differing architectures. Each architecture is usually defined by a particular instructicm set, hardware register set, and 
memory arrangement, etc. An architecture may also be referred to as a hardware platform for software execution. 
IS Software such as application programs which are written or compiled to be executed on a particular hardware platform 
may be referred.to as native code. An application program In the native code of a particular hardware platform usually 
does not run on other non compatible hardware platforms. 

[0003] Some software environments enable application programs to execute on a variety of differing hardware plat- 
forms. The application programs which execute under such a software environment usually take the form of a stream 
20 of instructions each of which conforms to a predefined instruction set supported by the software environment. Such a 
software environment typically interprets each of the Instructions in the stream and provides emulation of the instruc- 
tions in the native code of the particular hardware platform. The software environment itself may take the form of a 
virtual machine which executes In native code. 

[0004] One example of such a software environment is a Java virtual machine. A typical Java virtual machine func- 
26 tions as an interpreter for Java application programs. A Java application program typically take the form of a stream 
of Java byte code instructions and the Java virtual machine emulates each Java byte code instructbn using the native 
code of the particulai; hardware platform under which the Java virtual machine executes. Unfortunately, this type of 
emulatbn usually yields severely reduced Instructbn execution performance in comparison to applk:ation programs 
which are in native code. 

30 [0005] One prior method for improving the instruction execution performance in such a software environment is to 
provide the software environment with what may be referred to as a just -in-time compiler. Atypical just-in-time compiler 
Is a process that compiles an application program into native code. A just-in -time compiler may execute concurrently 
or sequentially with the virtual machine process that Interprets the application program. A just-in-time compiler typically 
generates a native code version of an application program which is thereafter available for executbn if the application 

3S, program is subsequently run. Unfortunately, prior just-in-tlme compilers typically consume large amounts of resources 
such as memory and processor cycles and are therefore not well suited for devices having relatively limited resources. 

SUIMIWIARY OF THE ilWENTION 

40 [0006] A virtual machine with a hybrid just-in-tlme compiler is disclosed that enables execution of a set of cross- 
platform code on a hardware platform. In contrast to prior just-in-tlme compilers, the just-in-time compiler disclosed 
herein consumes relatively few resources of the hardware platform by compiling only selected basic blocks of the 
cross-platform code and by making use of existing elements in the virtual machine that are otherwise used to interpret 
the cross-platform code. The just-in-time compiler is hybrid In that only selected basic blocks of the cross-platform 

45 code are compiled while the remaining portions are interpreted. 

[0007] In one embodiment, the virtual machine with a hybrid just-in-time compiler includes a code generator that 
compiles a selected basic block of the cross-platform code into a native code block for the hardware platform. The 
virtual machine in this embodiment further includes an interpreter that executes the cross-platform code by executing 
the native code block in place of the selected basic block and by interpreting a remaining portion of the cross-platform 

so code. An existing action table used by the Interpreter is also used by code generator to compile the native code block. 
[0008] Other features and advantages of the present Invention will be apparent from the detailed descriptton tliat 
folbws. 

BRiEF DESCRIPTION OF THE DRAWiNGS 

55 

[0009] The present inventbn is described with respect to particular exemplary embodiments thereof and reference 
is accordingly made to the drawings in whk:h: 
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Figure 1 shows a device that includes a virtual machine with a hybrid justHn-tlme compiler according to the present 
teachings; 



Figure 2 shows one arrangement of a just-in-time compiler in the virtual machine; 



5 



Figure 3 shows a procedure used by the code generator to compile a basic block of the crossi3latform code. 



DETAILED DESCRiPTION 

10 [0010] Figure 1 shows a device 10 that includes a virtual machine 12 with a hybrid just-in-time compiler according 
to the present teachings. The virtual machine 1 2 enables execution of a set of crossialatf orm code 1 4 on the particular 
hardware platform with which the device 10 is implemented: The virtual machine 12 interprets the cross-platform code 
14 and compiles selected portions of the cross-platform code 14 to improve instruction execution performance while 
minimizing the anrK>unt of resources of the device 10 that are consumed by compilation. 

IS [0011] The cross-platform code 14 represents any software which may be executed on a hardware platform that 
provides a suitable virtual machine environment for interpreting the instruction contained therein. The cross-platform 
code 1 4 may be an application program or a loadable class file or an individual function or method. In one embodiment, 
the cross-platform code 14 is an application program In Java byte code and the virtual machine 12 Is a Java virtual 
machine. 

20 [0012] In the following description, the cross-platform code 14 Is treated as Java byte code and the virtual machine 
12 as a Java virtual machine, it is apparent, however, that the present techniques may be readily applied to other 
programming languages that enable cross-platform execution. 

[0013] The virtual machine 1 2 partially interprets and partially compiles methods, routines or functions that may be 
included in the cross-platform code 14. Initially, the virtual machine 12 executes the cross-platform code 14 by inter- 
ns pretffig each byte code instruction contained therein. In addition, the virtual machine 12 detects one or more basic 
blocks in the cross-platform code 14 that are suitable for compilation. The virtual machine 12 compiles these bask: 
blocks to provide a set of native code blocks 20-24 each of which is in the native code for the particular hardware 
platform provkJed in the device 10. Once the native code blocks 20-24 have been compiled, the virtual machine 12 
executes the cross-platform code 14 by executing the native code blocks 20-24 where appropriate and by interpreting 
30 the remaining portions of the cross-platform code 14. 

[0014] It is a well known rule of thumb that most progranDS spend more than 80 percent of executk>n time on less 
than 20 percent of their code. It is therefore not necessary to compile and entire application programs or entire methods 
as is done in the prior art to gain speed of execution. It is sufficient to compile only the portions of the methods, routines, 
or functions that are heavily executed. Consider the case of a method that spends most of its execution time in a small 
35. loop that is executed 10000 times. The hybrid just-in-time compiler functionality implemented in the virtual machine 
12 compiles only this loop and thd remainder of the method Is interpreted during execution of the method. 
[0015] The following is example Java source code which corresponds to the cross-platform code 14. This example 
is a method that calculates the dot product of two vectors. 
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Example Source Code for the Crpss-Platform Code 



[0016] 
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void loopit ( ) {- 



double a [ J , bl] ; 
int i; 

double sum=0.0; 



TO 



Date dl« new date(); 
a « new double (count) ; 
b » new double [ count ) ; 



IS 



for (i=0; i< count; i+++) 
ati) = bti) = 10.0; 

for (i=sO; i< count; 

Sum = a[l] *b(ij+suiD; 

Date d2» new DateO; 



20 



long 11 « dl .getTime () ; 
long 12 « d2.getTime() ; 
12 = 12-11; 

Sys tern. out. print In (~ Time ="+ 12); 



[0017] . The cross-platform code 14 corresponding to this example Java source code consists of approximately 136 
25 Java byte code instructions. The highlighted fQr-toop shown above in this example Java source code consists about 
15 Java byte code instructions as set forth below. 

Example Basic Block 



58 


iload_3 


59 


daload 


60 


aload_2 


61 


i[oad_3 


62 


daload 


63 


dmul 


64 


dload4 


66 


dadd 


67 


dstore 4 


69 


iinc 3 1 


72 


lload_3 


73 


aload_0 


74 


getfield #14 <Field Dotcount l> 


77 


if Jcmpit 57 



so [0019] A compilation of the highlighted for-loop as a basic block, 15 out of 1 36 byte code instructions in the method, 
will eliminate approximately 69 percent of the compilation work in comparison to prior just-in-time compilers that compile 
entire methods or entire programs. This greatly reduces the resources that are needed in the device 10 to perform 
compilation. 

[0020] Moreover, the large majority of execution time for this example method is spent on the base blocks that are 
ss compiled into native code by the hybrid just-in-time compiler functionality of the virtual machine 12, i.e. the two for- 
ioops. The remainder of the byte code instructions of the example method are executed only once per execution of 
the method. This yields greatly enhanced instruction execution performance with minimal compilatk)n effort. 
[0021] Figure 2 shows one arrangement of a just-in-time compiler in the virtual machine 1 2. The virtual machine 1 2 
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includes an interpreter 50 that fetches the cross-platform code 14 and interprets each byte code instruction contained 
therein in sequence. In this context, the interpreter 50 may be characterized as an extremely large switch statement 
with case values being the opcodes of the instruction set supported by the virtual machine 12. 
[0022] The interpreter 50 accesses an action table 56 while interpreting the byte code instructions. The action table 
s 56 associates each byte code instruction that may be contained in the cross-platform code 14, i.e. each Java opcode, 
to a set of action code. Each set of action code is a set of native code Instructions that will perform the appropriate 
operations for emulating the con-esponding Java opcode. 

[0023] When the cross-platform code 14 is invoked for the second time, the Interpreter 50 calls a block detector 52. . 
In other embodiments, the block detector 52 may be called after the third or fourth, etc., time that the cross-platfomn 
10 code 1 4 Is invoked or some other condition. The block detector 52 identifies the basic blocks in the cross-platform code 
1 4 that are to be compiled. One example of a basic block Identified by the bkx:k detector 52 Is a for4oop as previously 
discussed. Other examples of basic blocks that may be suitable for compilation include function calls or method calls 
that are executed a large number of times. 

[0024] The block detector 52 creates a block boundary structure 58 which is a data structure that marks the bound- 
's aries of the basic blocks in the cross-platform code 1 4 that are suitable for compilation. In the example method shown 
above, the bask: blocks suitable for compilation are the byte code blocks corresponding to the for-loops shown in the 
source code. For example, the block boundary structure 58 lists the boundaries 57 and 77 of the highlighted for-loopi 
[0025] After the boundaries of the basic blocks have been identified, the interpreter 50 fetches and interprets eacp 
byte code instruction in the cross-platform code 14 while using the block boundary structure 58 to determine when it. 
20 reaches a basic block that is suitable for compilation. When one of the basic blocks is encountered, the interpreter 50 
invokes a code generator 54. 

[0026] The code generator 54 obtains the basic block from the interpreter 50 and generates a corresponding native 
code block 20-24. For example, the code generator 54 obtains byte code instructions 57-77 shown above and In 
response generates the native code bkx:k 20. In one embodiment, the code generator 54 ovenwrites the basic block * 

25 in the cross-platform code 1 4 with a reference to the native code block 20 so that the native code block 20 is executed 
the next time that the cross-platfomn code 14 is executed and the basic block is encountered. 
[0027] Figure 3 shows a procedure used by the code generator 54 to compile a basic block of the cross-platform 
code 14. The code generator 54 perfomns steps 60-62 for each bye code instructbn of a basic block such as the . 
example byte code instructions 57-77 shown above. 

30 [0028] At step 60, the code generator 54 fetches a set of action code that corresponds to the opcode of the current 
byte code instruction being compiled. In one embodiment, the action code is a set of native code instructions which 
are obtained from the action table 56. In this manner, the code generator 54 makes use of existing elements in the 
virtual machine 1 2 that are otherwise used to interpret the cross-platform code 1 4. This avoids the need for additional 
elements, and the resources they consume, as is the case In prk>r just-ln-tlme compilers. 

3S [0029] For example, assume that the action table 56 contains the following contents. 



Example Action Table 


Opcode 1 


native code instructtons A 


Opcode 2 


native code instruct»ns B 


Opcode. 3 


native code instructtons C 


Opcode 4 


native code Instructtons D 



^ [0030] Assume also that opcode 1 corresponds to the aload bye code instructk)n and that opcode 4 corespondslo 
the iload byte code instruction and that opcode 2 corresponds to the daload byte code instruction. When the code 
generator 54 encounters an aload instruction at step 60 it obtains native code instructions A from the action table 56 
as the action code. Similarly, when the code generator 54 encounters an iload instruction at step 60 it obtains native 
code instructions D from the action table 56 and so on. Although only four entries are shown, the action table 56 actually 

^ contains a set of native code instructions for each of the possible opcodes In the applicable Instruction set .whk:h In 
this example is Java byte code. 

[0031] At step 62. the code generator 54 concatenates the obtained action code to the native code block 20. For the 
example basic block shown above, the native code block 20 Is as follows after step 62 on byte code Instructbn 57. 
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Code Block 



native code instructions A 



[0032] After step 62 on byte code instruction 58, the native code block 20 is as follows. 
10 Native Code Block 



native 


code 


instructions 


A 


native 


code 


instructions 


D 



[0033] After step 62 on byte code instruction 58, the native code block 20 is as follows. 
20 Native Code Block 



native 


code 


instructions 


A 


native 


code 


instructions 


D 


native 


code 


instructions 


B 



[0034] The native code block 20 may also include an appropriate set of prologue instructions and an appropriate set 

30 of epilogue instructions. 

[0035] After completion of steps 60-62 on each byte code instruction in the basic block, the code generator 54 may 
perform an optimization on the native code block 20. For example, a peephole optimization may be performed. It may 
be preferable to empby a pattern-driven peephole optimizer to improve portability. The peephole optimization may be 
repeated multiple times with bigger window sizes used to optimized blocks in methods that are more frequently invoked. 

3S This provides an incremental optimization technique. 

[0036] The virtual machine 1 2 with a hybrid just-in-time compiler is advantageous in devices having relatively limited 
resources. This may include devices with relatively little or no file system resources and or minimal memory resources 
and or limited processor resources, Such a device may be an embedded system. Examples of embedded systems 
include telephones, audio and video equipment, home appliances, and computer peripherals. 

40 [0037] The foregoing detailed descriptbn of the present invention is provkJed for the purposes of illustration and is 
not intended to be exhaustive or to limit the invention to the precise embodiment discbsed. Accordingly, the scope of 
the present Invention is defined by the appended claims. 



45 Claims 

1 . A virtual machine that enables execution of a set of cross-platform code (1 4) on a hardware platform, comprising: 

code generator (54) that compiles a selected basic block of the cross-platform code (14) into a native code 
so block for the hardware platform; 

interpreter (50) that executes the cross-platform code (14) by executing the native code block in place of the 
selected basic block and by interpreting a remaining portion of the cross-platform code (14). 

2. The virtual machine of claim 1 , wherein the selected basic block Is a program loop In a method contained in the 
ss cross-platform code (14). 

3. The virtual machine of claim 1 , wherein the selected bask: block is a method which is invoked multiple times in 
the cross-platform code (1 4). 



6 



EP 1 037 145 A2 

4. The virtual machine of claim 1 , wherein the selected basic block is a function which is invoked multiple times in 
the cross-platform code (14). 

5. The virtual machine of claim 1 , wherein the code generator (54) generates the native code block in response to a 
s table used by the interpreter (50) for associating each of a set of opcodes which may be used In the cross-platform 

code (14) to a corresponding action code in terms of a native code of the hardware platform. 

6. The virtual machine of claim 1 , wherein the code generator (54) optimizes the native code block. 

10 7. The virtual machine of claim 1 . further comprising a block detector that determines a set of boundaries of the basic 
block in the cross-platform code (14) and a set of boundaries for each of a set of additional basic bkx:ks in the 
cross-platform code (14). 

8. The virtual machine of claim 7, wherein the code generator (54) compiles the selected basic block and each ad- 
is ditional basic block in response to the boundaries. 

9. A method for execution of a set of cross-platform code (14) on a hardware platform, comprising the steps of: 

i 

selecting a basic block of the cross-platform code (1 4) for compilation; 
20 compiling the basic block into a native code block for the hardware platform; 

executing the cross-platform code (14) by executing the native code block in place of the basic block and by 
interpreting a remaining portion of the cross-platform code (14). 

10. The method of claim 9. wherein the step of selecting a basic block comprises the step of selecting a program loop- 
2S in a method contained in the cross-platform code (14). 

11. The method of claim 9, wherein the step of selecting a basic block comprises the step of selecting a method which 
is invoked multiple times in the cross-platform code (14). 

30 12. The method of claim 9, wherein the step of selecting a basic block comprises the step of selecting a function which 
is invoked multiple times in the cross-platform code (14). 

13. The method of claim 9. wherein the step of compiling the basic block comprises the step of generating the native 
code block in response to a table used by the Interpreter (50) for associating each of a set of opcodes which nnay 

35 be used in the cross-platform code (14) to a corresponding action code in terms of a native code of the hardware 

platform. 

14. The method of claim 9, further comprising the step of optimizing the native code btock. 

40 15. The method of claim 9, wherein the step of selecting a basic block includes the step of determining a set of bound- 
aries of the basic block in the cross-platform code (1 4). 

16. The method of claim 15, wherein the step of compiling the basic block includes the step of compiling the basic 
block in response to the boundaries. 

17. The method of claim 9, wherein the step of selecting a basic block includes the step of determining a set of bound- 
aries for each of a set of addftk>nal basic blocks in the cross-platform code (14). 

18. The method of claim 17, further comprising the step of compiling the additbnal basic btock in response to the 
so boundaries. 
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